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(54) Expert system 

(57) An expert system, for example for help desk 
applications, provides output information, such as trou- 
bleshooting suggestions, in response to search queries 
and answers given by a user on questions generated by 
the expert system. The expert system comprises a 
knowledge database structure and files representing 
information about troubleshooting questions and possi- 



ble answers. For the generation of its output informa- 
tion, e.g., troubleshooting suggestions and solutions, 
the expert system does not only take into account the 
contents of said files, but also the relationship between 
the files, i.e. the structure defining how the information 
in said files belong together. 
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FIELD OF THE INVENTION 

[0001] The present invention relates to an expert sys- 
tem, for example for help desk applications. In particu- 
lar, the invention relates to an expert system comprising 
search result presentation and user guidance. In such 
help desk applications, a user who has problems with a 
hardware or software product typically contacts the help 
desk, for example by telephone or electronic mail, to get 
a solution for the problem. More particularly, the inven- 
tion relates to flexible systems for knowledge acquisi- 
tion, knowledge presentation, decision support and 
knowledge capturing used in the technical support and 
help desk environment. It also relates to the area of 
information management and knowledge base search- 
ing and automatic knowledge structuring. 

BACKGROUND OF THE INVENTION 

[0002] Artificial intelligence systems, also named" 
expert systems, have become more commonly used in 
the help desk or call center environment to enable users 
to provide the requested information to the customers. 
These systems normally use questions and answers to 
guide the user to the possible solution. Such systems 
are known from US 5 257 185 and GB 2 271 005. Some 
systems also provide the possibility to start the trouble- 
shooting or solution finding processes with a natural 
language search. Based on this search result the next 
questions are presented by the system. The decision 
which question is presented to the user is usually based 
on the content of the knowledge base and the submitted 
search string. The process leading to the presentation 
of this question to the user is not displayed. The user is 
thus not able to check rf this is the right question at this 
place and if the system leads him to the right informa- 
tion. None of the mentioned known systems deals with 
a method wherein the user can directly search the 
knowledge base. The two mentioned systems describe 
methods for user guidance based on question and 
answers from step to step, but they do not describe a 
method which presents the automatically determined 
information to the user after selecting a search result. 
[0003] Also, standard full text retrieval system, like 
existing web (Internet) search engines, are not very 
useful for help desk agents, because too many found 
information means too much time to find the right docu- 
ment in it. Like on the web, too much information leads 
to no additional helpful information. The agent has to 
review all of the found documents until he finds the right 
one. This takes too much time and additional effort. In 
such a case, the system has to provide additional ques- 
tions to the user to guide him to the needed information. 
This could be done by a additional property, like the 
relationship between the documents/information (e.g. 
references from one to another document on the web). 



which is helpful to find and evaluate the right one. 
[0004] So, the used search/evaluation algorithm or 
method builds the core of the help desk or support trou- 
bleshooting system. Search algorithms for expert sys- 

5 terns are very important, especially the search result 
has to be presented very clearly to the users. Especially 
when using a direct natural language search, the users 
very often lose the overview, because the systems do 
not present the information to the user why it evaluates 

10 this as the next needed question. This often leads to 
wrong solutions because the decision finding process is 
not completely clear to the user. 
[0005] The usage of an expert system with a well 
designed, easy to use and fast accessible user interface 

75 can enable the first line people to solve most of the cus- 
tomer problems during the first contact. Only cases 
which cannot be handled by the first line have to be 
transferred to more specialized people in the back- 
ground, who can answer the customer question. 

so [0006] Help desk environment search has to be very 
fast. Search results have to be easily correctable by the 
user. To be able to do this, the evaluation process has to 
be presented to the user. This makes it easy to adapt 
the existing customer problem to the retrieved problem 

25 from the knowledge base. It also enables the user to 
make checks if the problem retrieved from the system is 
similar to his/her problem. 

[0007] An expert system which meets the needs of the 
call center and help desk environment has to solve the 
30 following problems: 

1. fast search evaluation process, fast response 
time to search queries 

2. search result presentation should give the user 
35 the ability to check the machine evaluation process 

3. fast questions/answer guidance to solu- 
tion/needed information 

4. easy knowledge creation, maintenance, transfer 
process 

40 5. structured automatic knowledge capturing 

6. knowledge base structure has ability to quickly 
subdivide areas /domains 

7. automatic structured knowledge generation from 
external sources 

45 

[0008} Existing approaches like case base reasoning 
(CBR) or decision trees cannot meet these needs com- 
pletely. 

[0009] CBR cannot meet the need of high perform- 
so ance answers when the knowledge base becomes large 
like in the software problem troubleshooting environ- 
ment. 

[0010] Further, the solution finding and evaluation 
process is not clear to the user. Some of the CBR sys- 
55 terns provide a rule based functionality to automatically 
pre-answer questions to make this process clear to the 
user. 

[0011] This approach means additional maintenance 



2 

Copied from 09750150 on 11/23/2004 



3 



EP 0 915 422 A1 



work and is very sensible to typing errors or inconsistent 
rules. Pre-answered questions have to be generated 
online out of the submitted search query and not from a 
predefined set of rules together with the query. The doc- 
ument EP 334 113 discloses a method for automated s 
generation of inference processing which could be used 
for automated rule generation, but this system and the 
corresponding method is only adaptable to fact-based 
systems. In contrast thereto, the method of the present 
invention as described in more detail below, is adapta- w 
ble to each kind of pre-structured information, not only 
to fact-based systems. 

[001 2] Clear decision trees are very fast in access, but 
once a decision is made it cuts off all similar cases, 
which do not meet this decision. Due to this property, is 
decision trees do not allow to retrieve similar problems 
from different parts of the knowledge base. They are 
also very context-sensitive; questions and answers 
have to follow the same path. Standard decision tree 
methods also do not provide the ability to directly jump so 
into selected areas of the knowledge base. This is espe- 
cially the case for the systems disclosed in GB 2 271 
005 and US 5 257 185. Both known systems do not 
comprise a method for direct entry using natural lan- 
guage search or search query to enter the troubleshoot- 25 
ing process. Nor do the known systems even comprise 
a method how to evaluate such a search result, nor do 
they display this to the user. 

[0013] The core of all these known system is the 
search algorithm to find the right information or similar 30 
information in the knowledge base. After evaluation of 
the information, the selected information has to be pre- 
sented in such a form to the user, that the user can very 
quickly check if the presented information is the right 
information he needs, and if not, what has to be 35 
changed to find the right one. The additional solution 
information finding process has to be guided by e.g. 
questions and answers. A prior art example of a case 
based reasoning system is described, for example, in 
WO 92/15951, and a machine learning system which 40 
operates in conjunction with a relational database is dis- 
closed in WO 93/21587. 

SUMMARY OF THE INVENTION 

45 

[0014] It is thus an object of the present invention to 
provide an expert system which avoids the mentioned 
problems of prior art systems. 

[001 5] According to the invention, this object is met by 
an expert system defined by the features of claim 1 . so 
[0016] The invention thus provides a novel way of 
search result evaluation and user guidance. In an 
embodiment of the invention, all the questions and 
answers leading to a particular result are displayed to 
the user, thus ensuring, among others, that the user 55 
gets trust in the decisions of the system. 
[0017] The present invention addresses the above 
mentioned problems in the prior art by providing a defi- 



nition of a knowledge representation in a special struc- 
ture as well as an optimized search which uses not only 
the content but also structure, the given relationship 
between the distributed information parts, to find and 
evaluate the needed information inside of the knowl- 
edge base. 

[0018] The invention provides the definition of a 
knowledge base structure which allows a fast segmen- 
tation of the knowledge base into different categories, 
as well as the identification of similar information areas 
inside of the knowledge base. The presented knowl- 
edge base structure allows the reuse of existing infor- 
mation pieces to save additional work when creating or 
maintaining knowledge. 

[0019] The invention also provides a fast search 
mechanism to identify and select similar information 
pieces in big size knowledge bases of this structure. 
This mechanism provides also the possibility to identify 
the exact place of the information inside the knowledge 
base, which helps the user to check, if the found infor- 
mation corresponds to his needs. In detail, this means 
that the search automatically suggests the best match- 
ing piece of information and displays all automatically 
answered questions which are needed to lead to this 
information. This enables the user to check if the pre- 
sented information matches his needs. Furthermore, if 
a submitted search string cannot uniquely classify the 
information, the invention provides the ability to guide 
the user to a unique information piece by questions and 
answers or to even easily correct the suggested result. 
[0020] The invention also provides the ability to auto- 
matically load and convert pre-structured information 
into the knowledge base. This pre-structured informa- 
tion can be a CBR knowledge base or an existing deci- 
sion tree knowledge base. This can also be the content 
of a Intranet or Internet site, where the pre-structure is 
given by the links inside of the documents. It is only 
important that the information which has to be loaded 
into the knowledge base has a meta structure which 
represents the relationship between the different infor- 
mation pieces. Via this mechanism, the invention pro- 
vides for automatic structuring of information and 
automatic extension of the knowledge base. 
[0021] The invention also provides a user-friendly 
interface to access the knowledge inside the knowledge 
base. Due to the question/answer guidance of this inter- 
face, the user can find, without deep knowledge, the 
right information inside the knowledge base. 
[0022] Furthermore, the invention provides tools for 
manual creation of new or additional knowledge inside 
an existing knowledge base, as well as maintenance 
and administration tools for knowledge restructuring. 
Due to the chosen structure and knowledge representa- 
tion inside of the knowledge base, the invention pro- 
vides a knowledge maintenance mechanism based on 
usage and access statistics. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0023] In the following, an exemplary embodiment of 
the invention will be described in detail with reference to 
the drawings, wherein 

FIG. 1 shows an embodiment of an actual existing 
web (Internet) based user interface to the 
knowledge base. The left side of the screen 
presents the question answer guidance to 
the information, the right side of the screen 
presents the search engine results. This side 
is also used to present additional information 
from the unstructured part the knowledge 
base. 

FIG. 2 illustrates the outline of the knowledge base 
structure, with its naming convention, which 
allows to uniquely identify each piece of 
information inside of the knowledge base. 

FIG. 3 presents the first phase of the search evalu- 
ation process inside the structured knowl-* 
edge base to find the right piece of 
information. In this phase, only the content is 
taken to evaluate the search result. 

FIG. 4 demonstrates the first step of the second 
phase of the evaluation process, in which the 
structure and relationship between the infor- 
mation pieces is taken to make a reevalua- 
tion of the first phase results. 

FIG. 5 shows how the results of the second phase 
are taken to find the best matching informa- 
tion inside the knowledge base, and how the 
knowledge base is subdivided into similar 
clusters. 

Fig6 shows in detail an example how the results 
from a search query are displayed to the 
user on a screen. 

FIG. 7 shows an example of a screen display 
wherein search engine results are displayed 
to the user together with the automatically 
created history. 

FIG. 8 shows an example of the navigation possibil- 
ities for the user, taking into account the his- 
tory/path. 

DETAILED DESCRIPTION OF THE INVENTION 

[0024] A knowledge base structuring method which 
affords the above mentioned and other beneficial fea- 
tures in accordance with an exemplary embodiment of 
the invention will be described below with the reference 
to the FIGS. 1-8. Those skilled in the art will readily 
appreciate that the description given herein with respect 
to those figures is for explanatory purposes only and is 
not intended in any way to limit the scope of the inven- 
tion. 

[0025] For example, although the present invention 
was realized using UNIX commands to implement the 



needed algorithms and UNIX file system to represent 
and store the knowledge base, those skilled in the art 
will appreciate that the general principles of the inven- 
tion may be used with different operating systems and 

5 programming environments or languages. 

[0026] A particular embodiment of the invention will be 
described for the use of the invention in a help desk 
environment to support the help desk agents with trou- 
bleshooting information regarding technical software 

10 problems. To see the new concepts and ideas of this 
invention, it is important to understand the knowledge 
representation and identification inside of the knowl- 
edge base of the system, presented in FIG. 2. 
[0027] The symbols used in Figure 2 have the follow- 

15 ing meaning: 

Triangle with "Q" inside: question node file, name 
like node-id 

Square with "A" inside: action node file, name like 

20 node-id 

Rhombus with "C" inside: attached document 
Arrow starting from triangle: link via node-id name 
Circle with arrow starting from it: link via symbolic 
link in file system 

25 Designations of the type "dn/Q1.?.?" : node name 
(Node-ID) 

Designations of the type "dn/A1.?.?" : node name 
for an action. 

30 [0028] The knowledge inside of the knowledge base 
of the invention can be divided into two parts, an 
unstructured part shown at the right side of Figure 2, 
and a structured part shown at the left side. While the 
unstructured part consists of a collection of documents, 

35 or references to documents, the structured part is repre- 
sented by a network or directed graph of nodes; this 
structure can also be defined as a decision graph. In the 
structured part, the knowledge information is distributed 
over the different nodes, so that each node owns only 

40 one piece of information which is needed to lead to the 
next node. In the preferred embodiment for a help desk 
support system each node consists of a question 
together with answers, which lead to the next question 
until a final solution is found. This decision graph struc- 

45 ture is similar to a directed graph while the question cor- 
responds to a node in the graph, an answer 
corresponds to a directed edge of the graph. It is com- 
parable to finite state automata which are used in com- 
piler building techniques (e.g., A.V. Aho, R. Sethi, J.D. 

so Ullman: "Compilers", Addison Wesley). 

[0029] Each node in the structured part of the knowl- 
edge base can also contain a link/reference to a docu- 
ment in the unstructured part of the knowledge base. 
[0030] With this concept, the structured part builds a 

55 meta structure to the unstructured part of the knowl- 
edge base. This structure allows to represent a 
sequence of conditions and symptoms (e.g. questions 
and answers) which are needed to describe the result- 
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ing information. To uniquely identify each node insideof 
the structured part, the knowledge base has a special' 
naming convention for each node, this means in detail, 
that every node has a unique name, the node-id. Due to 
this naming convention, a fast subdivision of the knowl- 
edge base in parts belonging together is possible, as 
will be explained further below. 

[0031 ] The knowledge base has a hierarchical struc- 
ture. The most common node, or the first question has 
the node-id Q1 . This node represents the entry point to 
the knowledge base. This is the father node of all other 
nodes of the knowledge base. Each node below this 
node inherits the name of his father completed by the 
number of the information/answer which leads to this 
node. In detail this means if the father node has the 
node-id Q1.1. and three edges lead from this node to 
other nodes, these nodes have the node-id Q1.1.1, 
Q1 .1 .2 and Q1 .1 .3. If a node has a reference to docu- 
ments from the unstructured part of the knowledge 
base, these documents are also associated with the 
node-id of this node. FIG. 2 shows an example of the 
naming convention. In contrast to the document GB 2 
271 005, the described knowledge base also allows 
even cyclic graphs and not only trees. 
[0032] In the preferred embodiment of the invention, 
each node is represented by a single ASCII file in the 
UNIX file system. The file name corresponds to the 
assigned node-id. So each node can be easily identified 
by its filename which equals the node-id. 
[0033] Nodes which contain edges which lead to other 
nodes, question-nodes, are stored in a different direc- 
tory in the file system than leaf nodes, action-nodes 
which do not have any outgoing edges. This data stor- 
ing method allows separate management and reporting 
of the two possible types of nodes question- and action- 
nodes. The content of each node is described by an 
easy extendable description language. The complete 
definition of the knowledge database language for the 
nodes is described in extended BNF (Backus-Naur- 
Form) in the Appendix at the end of the present descrip- 
tion. 

[0034] A typical question node has the following struc- 
ture: 

QUESTION::ADMED. 1 5. 1 37.22. 1 26, 14:1 4 
08/26/97 ::What is the nature of your HP-UX prob- 
lem? 

LNKDOC::httpy/www.grc.hp.com 

ADDDOC::hpux/demo.htm 

ANSWER::none of the following ::Q 1.1 

ANSWE Ft:: lnstalation/upgrade::Q1 .2 

ANSWER::LVM::Q1.3 

ANSWER::Kernel:7krn/Q1 

BEGIN TEXT 

this area can contain additional text as description 
to the node 
END TEXT 



[0035] A typical action-node has the following struc- 
ture: 

ACTION::ADMED > hprtdc44.grc.hp.com,16:16 
5 02/12/97::HPUX;9.X tolO.X short instruction - 

upgrade 
BEGIN TEXT 

fax the attached document to the customer. 

10 END TEXT 

ADDDOC::hpux/upgrade-kurzanl.fax 
ADDDOC::hpux/upgrade_kurzanl.txt 

[0036] The present structure and naming convention 
15 of the invention provides the following advantages com- 
pared to the prior art: 

1. Due to the defined naming convention of the 
knowledge base this invention provides a fast iden- 

20 tification of similar information areas. This process 
is described in detail in the following parts (see the 
search algorithm). 

2. The chosen naming convention and structure 
allows a fast and easy method to determine the 

25 exact path to each node only by knowing the node- 

id. This allows a clear presentation of the search 
results to the user by providing of all needed infor- 
mation/answer which lead to this node. 

3. Due to the direct linked relationship between the 
30 nodes, each node knows about its successor 

nodes, the access time from one node to the other 
is constant, which is very important for fast help 
desk systems. 

4. Due to the chosen distributed knowledge storing, 
35 only small pieces of information are stored in one 

file, the structure allows efficient parallel access 
• and maintenance of this data. 

5. Furthermore, the naming convention allows the 
parallel extension of the knowledge base, without 

40 the problem that the contents get inconsistent. This 
feature is caused by the hierarchical structure of the 
naming convention and knowledge base. 

6. The invention also provides the ability to convert 
each existing pre-structured information into this 

45 structure, to get the benefits of this invention. For 
example, existing CBR knowledge bases can be 
automatically converted into this format to benefit 
from the search algorithm, or web sites can also be 
converted into this format to provide the user a 

so much better, structured and guided search to its 
content. 

The invention furthermore provides a very efficient 
method of identifying and presenting similar information 
55 inside of the. knowledge base. In the following part, the 
process of identification and presentation of information 
will be explained in detail. 

[0037] Today, existing search engines only use the 
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content of the stored documents to evaluate a search 
result. The present invention does not only take the con- 
tent of the documents to evaluate the search result, it 
also takes care of the structure or relationship in which 
the information belongs together. This method allows a 
much better evaluation of the information. In particular, 
it provides a question/answer guided search possibility 
which leads a user to needed information. 
[0038] In the approach according to EP 334 1 13, an 
inference is made for fact-based systems. Different 
thereto, the search evaluation method of the invention is 
not limited to fact-based expert systems, there is even 
no need to provide or define an additional structure as in 
the mentioned prior art method. 
[0039] A preferred embodiment of the search method 
consists of two phases which, combined together, give 
a result which is evaluated regarding content and struc- 
ture of the information. 

[0040] The first phase of the process, shown in FIG. 
3. makes an evaluation of the information inside the 
knowledge base only regarding content. For this step? 
an existing standard full text search engine or algorithm 
can be taken. In the preferred embodiment of the inven- 
tion the freeWAIS-sf (Wide Area Information Servers - 
structured fields, i.e.. a search engine) is taken for the 
content-related search evaluation. After this phase, 
each node gets a rating regarding its content (see FIG. 
3, numbers to the right of the triangles) . The rating of 
this node is made based on a user-submitted string to 
the search engine. This rating builds the base for the 
next phase of the evaluation process. The other sym- 
bols used in FIG. 3 have the following meaning (similar 
to the symbols in FIG.2): 

Triangle: node file, name like node-id 
Designations of the type "dn/Ql .1.1". node-id name 
Numbers (e.g., 0, 1,2, 3, 4): standard full text 
search rating 

[0041 ] The second phase of the process evaluates the 
knowledge base regarding structure and relationship of 
the nodes and f inishes with the best matching informa- 
tion inside the knowledge base as well as the next simi- 
lar information. The detailed process is also shown in 
FIGS. 4 and 5. 

This phase itself can be subdivided into two steps: 

1 . Phase 2a of search evaluation process, structure 
related evaluation (FIG 4.) 

2. Phase 2b of search evaluation process, evalua- 
tion and selection of best match (FIG 5.) 

[0042] Based on the results of the first phase during 
the phase 2a these results are used to reevaluate the 
knowledge base regarding relationship of the nodes. 
This process is made top down, so that each node gets 
a new value Vnew assigned by the following formula: 



Vnew = F(Vold, Vfathers, Vsons). 

[0043] Void corresponds to the value assigned to this 
node from the first phase, while Vfathers corresponds to 
5 the values assigned to the father nodes of this node, in 
this phase (2a). 

Vsons corresponds to the values assigned to the son 
nodes in the first phase. 

Vfathers as well as Vsons are vectors of values. This 
io means, one node can have more than one father as well 
as more than one son nodes. 

In the preferred embodiment the following formula is 

used for evaluation: 

F(x.yD.zD)= x+ sum (yd) • tnis means 

15 

Vnew = Void + sum (Vfathers) (Formulal) 

In the above formula, yD, zQ represent a vector of val- 
ues, sum (yfj) corresponds to the sum of all elements of 

20 the assigned vector. 

[0044] After finishing the top down evaluation process 
of this phase each node has a rating regarding content 
and relationship inside the knowledge base. 
[0045] The symbols used in FIG. 4 have the following 

25 meaning: 

Triangle: node file, name like node-id 
"dn/Ql.1.1" : node-id name 

Numbers in square brackets: phase 2a structured 
30 rating 

Other numbers: standard full text search rating 

[0046] The following phase 2b (FIG.5) subdivides the 
knowledge base into areas of similar information and 

35 finishes with the best matching information from the 
knowledge base, based on the query submitted by the 
user. During this process the information is evaluated 
bottom up, this means from the deepest nodes to the 
top. This means that evaluated values are processed 

40 from son to father node. Similar to the first phase the 
evaluation is done by the following formula: 

Vend = F(Vnew, Vfathersnew, Vsonsnew). 

45 Vend corresponds to the final new value of the 
node. 

Vnew corresponds to the value of this node from 
phase 2a. 

Vfathersnew corresponds to the values of the 
so fathers from phase 2a. 

Vsonsnew corresponds to the values of the sons 
from phase 2b. 

[0047] In a preferred embodiment, the following for- 
55 mula is used for evaluation: 

F(x.yD.zD)= max(zD) , this means: 

Vend=max(Vsons), (Formula2) 
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or the new value of the node is the maximum of the val- 
ues of its son nodes. 

[0048] Like in Formula 1, yD, zQ mean vectors of val- 
ues. max(zQ) selects the maximum of the vector ele- 
ments. 5 
[0049] The symbols used in FIG.5 mean the following: 

Triangle: node file, or attached cookbook 
"Dn/Ql.1.1" : Node-id name 

Numbers in square brackets: 2a. Phase structured >o 
rating 

Numbers in round brackets: 2b. Phase best path 
evaluation 

Other numbers: standard full text search rating 
Arrows with two heads: best solution path is 

[0050] After finishing this phase, there is at least one 
path through the knowledge base which fits best to the 
submitted query of the user regarding content and rela- 
tionship of the nodes to each other. A descending sort- so 
ing of the node regarding its rating present the next 
similar areas of the knowledge base. 
This evaluation process provides, compared to the 
existing search evaluation processes, the following 
advantages and new features: 2s 

1 . this evaluation approach takes care not only of 
the content, but also of the relationship of the infor- 
mation. This means that information which belongs 
together because of it relationship is evaluated 30 
together and not in an isolated or separated man- 
ner. This also means that the process f inishes in a 
much better evaluation of the information. 

2. Due to the chosen naming convention, the 
search result can be presented to the user together 35 
with all needed steps, which lead to this informa- 
tion. This give the user the ability to easily check if 
the presented search result really corresponds to 

his needs (see FlGs. 6 and 7) . It enables also the 
user to correct the search result and follow the 40 
guided question/answer structure to the next best 
fitting match (see FIGs 7 and 8). 

3. Due to the chosen naming convention in the pre- 
ferred embodiment, the search evaluation process 
consists of the following algorithm: 45 



4. Due to the distributed structure of the content 
and evaluation process, the evaluation can also be 
effectively implemented on massive parallel sys- 
tems. 

[0051 ] FIGs 6-8 further illustrate the advantages of the 
present invention. FIGs 6-8 are exemplary screen dis- 
plays of a computer as they are shown to the user of an 
expert system according to the invention. Figs. 6-8 also 
comprise "balloons", such as "search query", "start 
search", "rating", etc. in FIG.6. These "balloons" are not 
displayed on the computer screen, but only serve for 
explanation purposes in connection with FIGs 6-8. 
[0052] FIG.6 shows in detail how the results from a 
search query are displayed to the user. Besides the rat- 
ing of the result, the kind of the node, the final solution 
(exclamation mark) or further questions needed (ques- 
tion mark) are displayed to the user. FIG.7 illustrates the 
process how a user selected search result is automati- 
cally displayed together with the history or path informa- 
tion by the knowledge browser. FIG.8 shows the 
navigation possibilities to the user, using the history 
path presented by the search result, to correct the sys- 
tem generated suggestion 

[0053] The present invention is being used, for exam- 
ple, for help desk support of software and hardware 
problems in a response center. With the help of the 
present system, first line agents in the response center 
are able to solve problems which before needed spe- 
cialized qualifiers or response center engineers. The 
invention can also be used to provide a self-qualification 
and solution interface to customers on the Internet 
[0054] The invention can also be used to provide a 
much better interface to searching of web sites and 
automatic structuring of web information. Due to the 
usage of the structure and content, the evaluation is 
much better than with content only. Also, the ability to 
present the whole environment which leads to the infor- 
mation is very useful for the users to locate and check 
the presented information. Due to the distributed data 
structures of the invention, it is possible to provide addi- 
tional online editor and maintenance tools for the knowl- 
edge base. 



1 . Phase 1 evaluation produces a list of node-id 
together with rating 

2. sort the result list from step 1 ascending by 
node-id name so 

3. apply the evaluation formula (Formula 1) to 
the nodes top down 

4. sort the result list from step 3 descending by 
node-id name 

5. apply the evaluation of formula (Formula 2) 55 
to the nodes bottom up 

6. sort the result list from step 5 descending by 
last given rating of each node. 



1. An expert system, for example for help desk appli- 
cations, for performing a search result evaluation 
method, wherein the method provides output infor- 
mation, such as troubleshooting suggestions, in 
response to search queries and answers given by a 
user on questions generated by the expert system, 
comprising a knowledge database structure and 
files representing information about troubleshooting 
questions and possible answers, characterized in 
that for the generation of said output information, 
not only the contents of said files, but also the rela- 
tionship between said files, i.e. the structure defin- 
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ing how the information in said files belong 
together, is taken into account for providing trouble- 
shooting suggestions and solutions. 

2. An expert system as in claim 1 , wherein the expert 5 
system presents to a user the history of successive 
asked by the system. 

3. An expert system as in claim 1 . wherein the expert 
system presents to a user the history of successive 10 
questions automatically answered by the system 
depending on the submitted search query from the 
user. 

4. An expert system as in claim 1 or 3, wherein the is 
expert system presents to a user the history of suc- 
cessive questions automatically answered by the 
system which allows the user to change the auto- 
matically generated decisions and answers. 

20 

5. An expert system as in any of the claims 1 to 4, » 
wherein the expert system presents to a user the 
history of successive questions automatically 
answered by the system in a structured ques- 
tion/answer form. 25 

6. An expert system as in any of the claims 1 to 5, 
wherein the expert system permanently presents to 
a user the actual position inside the knowledge 
database in a structured question/answer form. 30 

7. An expert system as in any of the preceding claims, 
wherein all conditions and symptoms (for example, 
questions and answers) which lead to the particular 
search result, are displayed to the user. 35 

8. An expert system as in any of the preceding claims, 
wherein the selected search result is automatically 
presented in conjunction with the path information 
through the knowledge base which would lead the 40 
user to this result. 

9. An expert system as in claim 8, wherein path infor- 
mation is presented by a question and answer 
structure. 45 

1 0. An expert system as in any of the preceding claims, 
providing the capability for the user to correct the 
system pre-selected path. 

50 

1 1 . An expert system as in any of the preceding claims, 
wherein the expert system provides the functional- 
ity to automatically import pre-structured informa- 
tion, such as Internet web pages, into its knowledge 
database. 55 
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